HOW ARE SOCIAL MEDIA INFLUENCING VACCINATION? 


Behavioural interventions to reduce vaccine 
hesitancy driven by misinformation on social media 


Kai Ruggeri and colleagues vaccine misinformation on social media has strong effects on 
behaviour, and the evidence base for interventions to reduce these effects is limited, but better 
approaches to evidence generation are possible 


ffective population level vaccina- 
tion campaigns are fundamental 
to public health.’? Counter cam- 
paigns, which are as old as the 
first vaccines,’ disrupt uptake 
and can threaten public health globally.‘ 
In 2019, public health researchers linked 
increases in measles cases with the prolifera- 
tion of global anti-vaccine campaigns.’ Some 
of these campaigns originated offline but 
were later amplified and expedited through 
social media, resulting in real world harms.° 
Though crises and genuine safety concerns 
can also lower vaccine uptake,’ ê the return 
of measles after aggressive anti-vaccine cam- 
paigns prompted the World Health Organi- 
sation to list vaccine hesitancy among the 
greatest threats to global health (box 1). 
Anti-vaccine campaigns proliferated 
during the covid-19 pandemic” with 
undeniable effects including substantial 
increases in covid related illness and 
death.’>’” Even before March 2020, 
vaccine hesitancy was directly linked 
to misinformation (false, inaccurate 
information promoted as factual) 
spread on social media.'* Once covid-19 
reached pandemic status, social media 
was acknowledged as the epicentre of 
misinformation leading to hesitancy,” ”° 
and consequently, interventions to tackle 


KEY MESSAGES 


e Substantial evidence shows the nega- 
tive effects of vaccine misinformation 
on social media 


e Evidence on the effectiveness of 
interventions to correct or mitigate 
misinformation is considerably more 
limited and rarely includes measures 
of true vaccine uptake 

e The evidence available does indicate 
ways forward to develop better meth- 
ods, particularly those that would be 
less likely to backfire in the way that 
blanket social media bans have 

e The need for such actions is urgent 


hesitancy have globally focused on delivery 
through social media.” ?? 

Despite unprecedented levels of vaccine 
access and nearly real time communication 
on the development and availability of 
vaccines in 2020-21, public health officials 
struggled to keep pace with misleading or 
inaccurate content online.” As guidelines 
shifted with the emergence of new 
information, policy decisions were often 
perceived by individuals and groups who 
are prone to distrust or refute government 
messaging as a response not to evidence but 
to mistakes or lack of expertise.” A 2021 
randomised controlled trial (RCT) found 
that exposure to misinformation about 
covid-19 vaccines lowered the intent of 
recipients to vaccinate, even among those 
reporting before exposure that they would 
“definitely” accept vaccination.” Similar 
findings globally indicate that social 
media dynamics exacerbated the sharing of 
misinformation, reduced vaccination rates, 
undermined trust in reliable information, 
magnified polarisation, and damaged the 
perceived credibility of institutions.”**° 
These challenges remain today. 


Approaches to reducing vaccine hesitancy 

Standard behavioural approaches to 
encourage vaccination include mandatory 
vaccination and regulation for healthcare 
professionals, incentives, public health 
communication campaigns, and engaging 
trusted leaders.** Contemporary methods 
have started to be implemented on social 
media,’°*’*? including debunking (fact 
checking specific claims after they have 
reached social media users) and “pre- 
bunking,” a behavioural approach in which 
users are taught about how “fake news” 
works before exposure.*’ Other interven- 
tion types include warning (“inoculating”) 
people about manipulation tactics using 
non-harmful exposure as a tool to iden- 
tify misinformation, and using accuracy 
prompts to trigger people to consider the 
truthfulness of material they are about to 
share on social media platforms, without 
stopping them from posting.” Recognising 
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the intense effect of social media on vaccine 
hesitancy,” the Africa Centres for Disease 
Control and Prevention developed a toolkit 
to assist countries in social media strategies 
aimed at encouraging vaccination.” 

Such behavioural approaches to 
misinformation on social media have 
shown promise in reducing the sharing of 
disinformation and misinformation (box 
1) and in changing people’s beliefs,** but 
less clear is their effect on vaccination 
uptake. Investigating the success of such 
interventions on uptake is essential 
because there is an established link 
between social media exposure and offline 
beliefs that vaccines are unsafe.” It is 
clear, however, that providing fact based 
probabilistic information alone fails to 
meaningfully increase uptake“? and might 
even backfire.“ Factors such as low trust 
in governments and health institutions 
are likely to be instrumental in derailing 
effective immunisation programmmes.”” 
Multiple drivers and barriers to vaccine 
uptake must therefore be considered when 
developing effective tools. 


Evaluating interventions to reduce vaccine 
hesitancy 
We identified 30 studies evaluating inter- 
ventions to tackle misinformation on social 
media that explicitly captured real world 
behavioural outcomes (see supplementary 
information on bmj.com). After excluding 
19 studies for lack of external validation, 
only 11 published interventions were left 
(table 1; box 2; fig 1). There is clearly insuf- 
ficient evidence from field studies on social 
media interventions. Only two interven- 
tions that met all criteria came from outside 
the US (Israel? and Nigeria”), with a recent 
study conducted in Nigeria producing per- 
haps the most robust level of evidence. 
Some evidence exists from field studies 
that did not directly target misinformation 
but provided accurate and useful 
information about vaccines. These were 
typically posted on interactive websites 
or directly in social media feeds. Changes 
in attitudes, knowledge, and social media 
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Box 1: Vaccine hesitancy 


Here, we use the term “vaccine hesitancy” as originally defined by WHO”: a “delay in 
acceptance or refusal of vaccination despite availability of vaccination services.” This 
definition, plus the expanded description ofvariation based on time, place, and population, 
gives a broad understanding but also allows us to distinguish vaccination behaviour from the 
underpinning psychological, environmental, and structural aspects influencing behaviour. 
This definition is most commonly used in literature pre-dating covid-19. Though there are 
debates about the most appropriate terms (“vaccine demand” is an alternative, for example) 
or updated definitions (including the updated WHO version) to use, applying the original WHO 
definition ensured that we captured relevant insights and evidence from the literature. °"? We 
also identify disinformation as a form of misinformation that deliberately seeks to mislead or 
otherwise disrupt understanding, although we cover both broadly under misinformation for 


the purposes of this paper. 


engagement were reported for several 
information campaigns using social media 
advertisements in before and after designs 
and designs without control groups.“ “^ 
“7*8 But these studies showed no changes 
in vaccination behaviours. Only two 
studies, both RCTs, showed that tackling 
vaccination concerns and providing 
information in interactive formats on 
a website increased vaccination”® and 
reduced days undervaccinated.** 

Two interventions that increased 
vaccination uptake used targeted 
messages through Facebook adverts” and 
personalised influencer content.** But each 
had limitations. In the first, vaccination rates 
increased only among families of medium- 
low socioeconomic status, indicating narrow 
effectiveness. In the second, the measures 
were primarily attitudinal, and behavioural 
outcomes were self-reported. 

Linking online campaigns to true 
behaviours in field studies is a major 
challenge. This is partly because running 
well controlled studies is simpler in 
laboratory experiments and surveys, and 
because capturing distal effects (true 
behaviours) of web based studies is often 
impossible. But showing some measures of 
success in increasing uptake is necessary to 
justify investment to develop interventions 
at scale. Therefore, it is critical that 
researchers of vaccine behaviours and 
associated campaigns engage directly 
with clinics and public health agencies to 
improve the ecological and external validity 
(that is, real world, observed outcomes) of 
interventions (box 2). 


Developing better interventions to confront 
vaccine hesitancy on social media 

Few interventions among those we evalu- 
ated captured evidence about real world 
behaviours, so there is currently no gold 
standard toolkit that public health agencies 
can refer to.°° But the evidence available 


can inform future tool development. We 
provide 10 insights based on the existing 
evidence that should help provide a clearer 
and more specific, evidence driven toolkit 
of approaches to reduce vaccine hesitancy. 

e Negative sentiments on social media 
might increase vaccine hesitancy faster 
than interventions reduce it?’ *°— 
Although vaccine hesitancy can stem 
from many sources, including mass 
media and political rhetoric as well as 
genuine safety concerns, there is ample 
evidence of a proliferation of anti-vaccine 
messages on social media leading to 
organised offline actions and increased 
hesitancy. This is driven by several 
social and individual factors, as well 
as foreign disinformation campaigns 
and bots.*' © There is less evidence 
that efforts to specifically mitigate 
misinformation have had a reliable effect 
on real world vaccine uptake. 

e Messaging seems to work best when it is 
tailored to what groups know and care 
about—Two relatively large vaccination 
interventions, one for flu, one for human 
papillomavirus (HPV), found modest 
effects through targeting specific groups. 
Broad campaigns through all forms of 
media tend to be generally effective. But 
once misinformation and conflicting 
views are prevalent, speaking directly 
to audiences, knowing the reasons for 
hesitancy, and framing information in 
a way that matters to individuals are 
critical.” © $ 

e Simple messaging about benefits and risk 
based on probabilities is not enough— 
Filling vaccine knowledge gaps has 
direct benefits, such as supporting 
informed decisions,® but messaging with 
information about benefits, harms, and 
associated probabilities is insufficient 
to resolve vaccine hesitancy.“ Some 
possible explanations include lack of 
trust and cultural values, which have 


a major effect on how scientific data 
are interpreted and accepted through 
social media." Messages must be 
conveyed in a way that affirms individual 
cultural values, dealing with topics 
of importance to individuals, not only 
health facts, using credible sources of 
information.“ Visual imagery also helps 
deliver effective messages, and other 
components should be considered, such 
as health literacy, simplified language, 
and context specific features like age or 
language. 

Correct misinformation to both parents 
and their children—Parents, especially 
mothers, play a major part in child 
vaccination.’ One large campaign 
carried out on Facebook directed at 
mothers of teens had some positive 
effects in specific income groups, but 
the overall effect was minimal to null. 
Addressing parents is clearly of value, but 
young people also seek out information 
online for themselves.®? Thus, the 
information teens are presented with 
online likely needs similar but unique 
safeguards against misinformation to 
the ones discussed. Directly involving 
parents and young people in the design 
of messaging might strengthen the 
effectiveness of these campaigns.” 
Trust matters: the message,” the 
messenger,” and the (vaccinated) 
provider” —Substantial amounts of 
anti-vaccine messaging comes from 
non-medically qualified, or non-expert, 
voices on social media.’ Thus, medical 
professionals are under-represented 
when it comes to legitimate and accurate 
information about vaccines on social 
media,” despite typically being the 
most trusted sources (especially among 
parents”“). Trust is potentially the most 
distinct characteristic of successful 
vaccination campaigns,” ”° and this 
includes ones delivered on social 
media.’° Ultimately, the source of the 
message—whether a healthcare provider, 
a politician, or a social media influencer— 
is likely to have a major role in whether 
individuals and communities deem 
information to be credible.” °? These 
interventions have great potential when 
delivered to the right population.*° The 
US state of New York, for example, was 
a stronghold of anti-vaccine sentiment 
before 2020, which pivoted after the 
arrival of covid-19. Despite intensifying 
hesitancy and misinformation waves, 
the state outpaced the national average 
for vaccination rates, benefiting both 
public health” and economic returns.” 


doi: 10.1136/lomj-2023-076542 | BMJ 2024;384:e076542 | thebmaj 


‘WYyBuAdoo Aq paye}o1q “Jsenb Aq pzoz Avenuer gz uo ywo? fwuq'mmw:dyy wo papeojumoq “p20 Menuer 9} UO Z~G9/0-EzO0e-IWA/9E} LOL SB paysijand suy (Ng 


HOW ARE SOCIAL MEDIA INFLUENCING VACCINATION? 


Table 1 | Interventions to reduce vaccine hesitancy through social media that assessed real world vaccine behaviours 


Study and 
country Vaccine Demographics Type of hesitancy Methods Intervention and outcome 
Chodick et al. HPV Mothers of teen Lack of knowledge RCT Facebook adverts addressing issues and concerns 
CO2 daughters about HPV and the vaccine with inoculation 
Israel elements had positive effects on vaccination rates 
in the second quarter by socioeconomic status, a 
negative effect in the lowest quarter, and no effect in 
higher socioeconomic levels 
Brandt et al. HPV College students Underestimating severity Questionnaires Facebook group posts, weekly emails, and open- 
2020)“ and susceptibility ended reflection appealing to personal benefits and 
USA health education showed increased knowledge but 
had no significant effect on self-reported vaccination 
Bonnevie et al. Flu African American and Group norms Before and after Influencer created content campaigns showed 
2020)” Hispanic US residents increases in positive vaccine beliefs and small but 
USA non-significant effects on self-reported vaccination 
O'Leary et al. Idap, flu Pregnant women Concerns about vaccines RCT A website with vaccine information and interactive 
2019)° due to providers’ lack of social media components had medium positive 
USA time and resources to effects on vaccination rates specifically among 
inform pregnant women 
Ortiz et al. HPV Adolescents Lack of knowledge Before and after Health facts appearing in Facebook news feed every 
2019)” 4 to 5 days showed increased knowledge but 
USA no effect on vaccinations 
Mohanty et al. HPV Adolescents Lack of knowledge and Intervention without Facebook advertisement campaigns directing to a 
2018)" awareness control website to schedule vaccination reached a large 
USA audience but had no effects on vaccination rates. 
Sundstrom et al. HPV College-age women Underestimating severity Focus groups and Information posts on several social media outlets 
2018)” and susceptibility survey increased self-reported vaccination, though no 
USA statistical test was conducted 
Huang et al Flu Undergraduate Difference in Social media campaign appealing to students’ 
2018)” students difference community identity had positive effects on 
USA vaccination rates 
Glanz et al ultiple early Pregnant women Misinformation on social RCT Website with vaccine information and interactive 
AOD) childhood media social media components reduced the days 
USA vaccines undervaccinated of infants with medium effects 
specifically among pregnant women 
Shropshire et al. Flu University students Concerns about Post-vaccination survey Multimedia campaign about flu vaccine including 
MONE vaccines, underestimating social media outlets had positive effects on 
USA susceptibility vaccination rates 
Evans et al. COVID-19 Facebook users Lack of positive social Quasi-experiment Social media campaign focused on promoting pro- 
2023) norms vaccination social norms using social influencers 
igeria had positive effects on self-reported vaccination. 


This success is attributed to strategies 
that, on top of tackling misinformation, 
also cultivated trust in the source of the 
vaccine, the messenger, and the provider, 
involving use of the military (a highly 
trusted organisation in the US), diverse 
community messengers (including 
community health workers and faith 


leaders), and a broad network of 
vaccination locations.’”** These aspects 
must be ensured in public campaigns 
aimed at specific groups, especially those 
who are vaccine hesitant.” 


e Debunking efforts have shown mixed 


effects on social media—Distributing 
information from public institutions or 


Box 2: A robust research agenda for social media interventions is needed 


Studies on reducing vaccine hesitancy can inform broader vaccination messaging campaigns. 
We recommend some critical features that should be included for all interventions (fig 1). 
Details about the type of vaccine and the target group should be highly specific, as should the 
form of hesitancy and misinformation,” the misinformation source, and details of the method 
(especially for RCTs). Real world effects (ideally direct and broader public health indicators) 
must be captured. These aspects are relevant for better understanding of what might work and 
for what reasons and for comparison between methods and social media platforms. The most 
informative approach would cover the first three levels of evidence under the THEARI system 
(theoretical, empirical, and real world).*° Over time, these would accumulate to the fourth 
(replicated) and fifth (well established impact) levels, maximising the potential for predictive 
validity of applications to public policy (for example, greater confidence in anticipated 
effects). Doing so would exceed the criteria listed in a recent call for a gold standard for trials 


tackling vaccine hesitancy.*° 
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providing objective information from 
third parties might help to counter 
misinformation, reduce the intention 
to spread misinformation, and promote 
health behaviours, but the process is not 
always smooth. The backfire effect is a 
concerning pattern in which disproving 
misinformation reinforces it and deepens 
false beliefs.*? But this phenomenon is 
not consistently observed in practice. 
Effects of debunking might be highly 
dependent on the recipient’s background 
knowledge and beliefs, methods of 
presentation, and what other information 
is viewed.**® For now, the immediate 
priority for this approach is to determine 
if inoculation based on pre-bunking can 
reliably reduce the noxious effects of next 
widespread waves of misinformation and 
resulting misbeliefs. 

Raising the quality and visibility of 
reliable health information can counter 
misinformation—Providing simple 
probabilistic information is not likely to 
completely counteract misinformation 
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1. Type of vaccine 


2. Psychological, 
social, and 


environmental 
measures 


4. Outcomes 


3. Methodology 


Form of hesitancy 
Fear, trust, politics, risk 
perception, and beliefs 


Vaccine 
M 


MR, HPV, flu, covid-19 


Source of hesitancy 
Social media, cultural, 
religious, and social 
institutions or networks 


Demographic 
Age, race, socioecomic 
status, religious 
and cultural traditions 


Methods 
Experimental design 
(RCT, natural, stepped 


Behavioural 
Individual vaccinations, 
group/community 


wedge), group/ aggregates 
comparisons. 
non-field methods Psychological 


Intentions, perceptions, 
beliefs, knowledge, 
and attitudes 


(surveys, lab studies) 
L 


E 
Intervention features 
Messaging/framing, 


social norms, reduce Population 
barriers, highlight Measure of illness, 
benefits, incentives, death, 


hospitalisations, and 
economic effects 


and penalties 


Platform 
Meta (Facebook, 
Instagram, WhatsApp), 
YouTube, TikTok, 
X (Twitter), Reddit, 
Discord, Telegram 


Fig 1 | Critical aspects of studies that are necessary to better understand and compare possible 
interventions that tackle vaccine hesitancy on social media (described in box 2). The examples 
of what specifically to measure and observe are non-exhaustive. All aspects should be included 
for maximum value, though behavioural and population health outcomes should be prioritised. 


on its own, but providing information 
on how, where, and when to get a 
vaccine does.’ć The high volume of 
misinformation appearing in online 
searches, however, can override 
more reliable sources,* limiting the 
effectiveness of high-quality information 
campaigns.*’ To increase campaign 
effectiveness, interactive designs and 
visual aids such as posters or videos 
help target populations see and engage 
with accurate, accessible information 
throughout a campaign.” Making it easier 
to find such materials is paramount, 
starting with search engine optimisation 
to increase visibility of campaigns. 

e Framing of vaccine messages matters— 
How public campaign messaging is 
framed affects health decision making. 
A public campaign can’t cover all 
vaccines, diseases, populations, and 
reasons for hesitancy; framing messages 
to be directly relevant to a populations’ 
needs (benefits and risks specific to 
their group) have resulted in significant 
increases in uptake.** Positive and 
negative framing effects are not 
equivalent,°’ however, and this should 
be factored into messaging decisions. 

e Blanket bans can drive groups and 
activities underground—Broad social 
media bans of individuals or of 
specific content can paradoxically 
result in the spread of misinformation 


and can galvanise problematic echo 
chambers by driving discussion into 
private social media groups or closed 
forums.”°*' Such closed environments 
are unlikely to include different 
viewpoints or corrective information, 
so misinformation is more likely to be 
reinforced. Rather than rely on outright 
bans, policy makers and content 
managers should explore methods 
that limit the spread and influence of 
misinformation.” 

e Social media platforms need to be part of 
the solution—If social media platforms 
are the epicentre of misinformation, 
then social media companies need to be 
part of the solution.” During the covid- 
19 pandemic, social media platforms 
took a more interventionist approach to 
content moderation than before (and, in 
some cases, removed or limited covid- 
19 misinformation and conspiracies). 
Some of these approaches are now 
being rolled back, and social media 
researchers’ access to data about 
behaviour on the global platform X 
(formerly Twitter) is being limited. 
Content labelling and corrective actions 
have produced some positive effects,” 
but social media companies should 
be more proactive in dealing with the 
proliferation of misinformation on their 
sites.” We endorse calls” to make data 
available and to work with researchers 


and regulators in all countries to enable 
developing effective solutions. 


It is worth it to get these campaigns right 
Misinformation is not new and its noxious 
consequences are not insurmountable, 
but its effect on vaccine hesitancy through 
social media is an urgent global threat to 
public health. Increasingly robust evidence 
has shown the drivers and effects of this 
phenomenon, but few successful, let alone 
replicated, interventions exist. One impor- 
tant step towards developing more effective 
interventions is the close monitoring of 
public perceptions and opinions about vac- 
cination and services. Digital technologies 
make it possible to analyse large quanti- 
ties of “social listening data” in real time.”® 
Such information would complement the 
evidence we already have from a variety of 
study types, improving the design of new, 
robust, and appropriately targeted inter- 
ventions. Because most published interven- 
tions focused on attitudes and intentions 
rather than on actual vaccination, how- 
ever, there remains an urgent need for 
direct partnerships between behavioural 
researchers with healthcare clinics and 
public health agencies.” Meaningfully 
developing those partnerships promises 
direct benefits for more reliable scientific 
insights that would improve the health and 
well being of entire populations. 
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